Introduction: Audio/Visual

Audiovisual integration: an introduction to behavioral and neuro-cognitive methods

Advances in neurocognitive and quantitative behavioral techniques have offered new insights to the study of cognition and language perception. This includes ways in which neurological processes and behavior are intimately intertwined. Examining traditional behavioral measures and model predictions, along with neurocognitive measures, will provide a powerful theorydriven and unified approach for...

Language and Speech Audiovisual Prosodyy Introduction to the Special Issue

Audiovisual Perceptio

This study investigates the use of audiovisual cues in the perception of sound contrasts which have a different phonemic status in the listeners’ L1 and L2. Two contrasts differing in the distinctiveness of their visual gestures (/b/-/v/ and /p/-/b/) were presented to Spanish learners of English in audio, visual and audiovisual modalities. Overall identification rates were not significantly hig...

A Context-Based Audiovisual Representation Model for Audiovisual Information Systems

In this paper we present a contextual representation model of audiovisual (AV) documents for AV information systems. In the rst part, we study AV medium, and show that AV intra-document context is always related to a user task seen as a general description task. We then present the AI-Strata model for AV description: audiovisual units (pieces of AV documents) are annotated with annotation eleme...

Audiovisual source separation

Blind source separation (BSS) can be seen as a generalization of denoising a noisy signal when several sensors are available. Each of them records the same physical phenomenon in a different way: such a diversity is then useful to separate the present signals for instance by independent component analysis (ICA) or sparse component analysis (SCA) [1]. The main objective of speech separation/extr...